REMARKS 

The present invention is a mobile communication terminal and a method of 
capturing infrared images. A mobile communication terminal 1 in accordance with 
an embodiment of the invention includes a digital camera having an angle of view; 
an infrared transceiver which is disposed under cover part 60 for emitting a beam of 
infrared light through an infrared port and through which a wireless connection is 
also provided between the terminal and other devices as described on page 6, lines 
9-16, of the Substitute Specification whereby an angle of view of the digital camera 
and the infrared light beam are directed such that a substantial part of the angle of 
view is overlapped by the emitted infrared light beam so that objects in the angle of 
view may be illuminated by the infrared beam and the transceiver receives through 
the port infrared light reflected by the objects which are illuminated by the light beam 
of infrared light. 

The title of the application has been amended as requested by the Examiner. 

The specification has been amended to provide a description in the Brief 
Description of the Drawings of Figs. 3a-3c. Accordingly, new drawings are not 
required. 

Claims 33, 36, and 37 have been amended as requested by the Examiner. 

Claims 19, 21-25, 29, 30 and 34-40 stand rejected under 35 U.S.C. §103 as 
being anticipated by United States Patent 6,580,459 (Uchino). These grounds of 
rejection are traversed for the following reasons. 

Independent claims 19 and 34 have been amended to substantively recite a 
digital camera and an infrared transceiver with the transceiver emitting a beam of 
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infrared light through an infrared port and through which a wireless connection is 
also provided between the terminal and other devices with the infrared transceiver 
also emitting a beam of infrared light which illuminates objects which are also within 
the view of the digital camera with infrared light with the transceiver receiving the 
infrared light reflected by the objects illuminated by the beam of infrared light. This 
subject matter has no counterpart in Uchino. 

Uchino discloses a digital camera which includes the ability to sense infrared 
images. A single CCD device captures both an infrared image of an object or a 
visible image of an object. A filter is utilized to cut the band of light which the CCD is 
not intended to provide at the time of capturing an image thereof. See column 3, 
lines 36-67, through column 4, lines 1-35. 

Uchino has no counterpart of the claimed combination of a digital camera and 
a transceiver which both emit an infrared light beam to illuminate an object and 
receive the reflected light beam through an infrared port with the infrared transceiver 
further providing a wireless connection between the terminal and other 
communication devices. Accordingly, the rejected claims are not anticipated by 
Uchino. 

Moreover, there is no basis why a person of ordinary skill in the art would be 
led to modify the teachings of Uchino to arrive at the subject matter of the claims as 
amended. The present invention provides for dual purpose utilization of the infrared 
transceiver which has utility both for the providing of infrared light to illuminate an 
object and capture the infrared light reflected from the illuminated object and to 
further provide for wireless connectivity between the terminal and the other devices. 
There is no basis in the record why a person of ordinary skill in the art would be 
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motivated to modify the teachings of Uchino to provide for an infrared transceiver 
which both illuminates and acquires an infrared image and further provide 
connectivity using infrared light emitted by the transceiver between the terminal and 
other devices given Uchino's design of using a single CCD to both acquire visible 
and infrared images and to further not provide connectivity to an infrared port. 

The dependent claims 21-25, 29, 30 and 35-40 define further aspects of the 
present invention which are not anticipated by Uchino. 

Claims 20 and 26-28 stand rejected under 35 U.S.C. §103 as being 
unpatentable over Uchino in view of United States Patent 6,023,292 (Wakui). These 
grounds of rejection are traversed for the following reasons. 

The teachings of Wakui do not cure the deficiencies noted above with respect 
to Uchino. Wakui discloses a video camera with a remote controller which utilizes 
an infrared link to provide communications between the controller and the video 
camera. A person of ordinary skill in the art would not consider the teachings of 
Wakui to cure the deficiencies noted above with respect to Uchino. 

Claims 31-33 stand rejected under 35 U.S.C. §103 as being unpatentable 
over Uchino in view of United States Patent 6,304,728 (Bittner). These grounds of 
rejection are traversed for the following reasons. 

Bittner has been cited as teaching a camera having a lens cover coupled to 
an actuator. However, the teachings of Bittner do not cure the deficiencies noted 
above with respect to Uchino. 

In view of the foregoing amendments and remarks, it is submitted that 
each of the claims in the application is in condition for allowance. 
Accordingly, early allowance thereof is respectfully requested. 
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To the extent necessary, Applicants petition for an extension of time under 
37 C.F.R. §1.136. Please charge any shortage in fees due in connection with the 
filing of this paper, including extension of time fees, to Deposit Account No. 01-2135 
(1 149.41056X00) and please credit any excess fees to such Deposit Account. 

Respectfully submitted, 

ANTONELLI, TERRY, STOUT & KRAUS, LLP 




Donald ErStout 
Registration No. 26,422 
(703) 312-6600 
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SECOND SUBSTITUTE SPECIFICATION 

MOBILE TERMINAL WITH DIGITAL CAMERA AND 
METHOD OF CAPTURING VISIBLE AND INFRARED IMAGES 

BACKGROUND OF THE INVENTION 
Field of the Invention 

fOOOn The present invention relates to mobile communication 

terminals, in particular mobile communication terminals that comprise a source 
of infrared light, such as an infrared port and a digital camera. 

Description of the Prior Art 

r00021 U.S. Patent 6,031,825 discloses a system for providing an infra 

red link between a mobile phone and its accessories. The mobile phone is 
provided with an infrared transceiver comprising an infrared receiver and an 
infrared LED. The infrared port provides for a wireless connection between the 
phone and its accessories, such as a personal computer, a printer, or another 
phone to transmit data, audio, control and logical signals between them. 

r00031 Recently, mobile phones have been equipped with digital 

cameras. EP-A-0 898 405 discloses a mobile phone provided with a digital 
camera and an infrared port. The mobile phone has an upper case and a lower 
case connected by a connection part. The infrared port and the digital camera 
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are both arranged in a connection part, facing opposite directions. The camera 
can capture images using visible light. 

[0004] Charged Coupled Devices (CCDs) that are used in commercially 

available digital cameras are sensitive both to light in the visible spectrum and 
in the near infrared spectrum. These digital cameras are therefore provided 
with infrared filters so that interference by any infrared light entering the camera 
is avoided. 

SUMMARY OF THE INVENTION 

r00051 The availability of infrared light and the inherent sensitivity of 

CCDs to infrared light offers an hereto unrealized potential to use 
communication terminals equipped with an infra red port and a digital camera 
to capture infrared images. On this background, the present invention provides 
a mobile phone of the kind, which can be used to capture infrared images. A 
mobile communication terminal in accordance with the invention comprises a 
digital camera having an angle of view, the mobile communication terminal 
further comprising a source of infrared light for emitting a beam of infrared light, 
whereby the angle of view and the infrared light beam are directed such that a 
substantial part of the angle of view is overlapped by the infrared light beam so 
that objects in the angle of view may be illuminated by the infrared light beam. 

r00061 The source of infrared light may be movable so that the direction 

of the infrared light beam can be substantially aligned with the angle of view. 

r00071 The mobile communication terminal may further comprise an 

infrared filter that can be moved in and out of the light path into the camera. 



r00081 The mobile communication terminal may be provided with an 

infrared filter that has a first position in the light path and a second position out 
of the light path. 

r00091 The mobile communication terminal may comprise electro 

mechanical or electronic means to move the infrared filter from the first position 
to ht e s e cond t he second position and back. 

100101 The mobile communication terminal may comprise a display, for 

displaying images captured by the camera. The images captured by the 
camera may be refreshed at regular intervals. 

r00111 In a preferred embodiment at least 60% of the viewing angle is 

overlapped by the infrared light beam, preferably at least 80 % of the viewing 
angle is overlapped by the infrared light beam, and even more preferable at 
least 90% of the viewing angle is overlapped by the infrared light beam. 

TO0 121 The mobile communication terminal may be provided with 

software for processing captured digital images. 

r00131 The mobile communication terminal may comprise a focusing 

system which focuses the light coming into the camera, whereby the focusing 
system has a first setting adjusted to the characteristics of visual light and a 
second setting adjusted to the characteristics of infrared light. 

r00141 The mobile communication terminal may comprise a lens cover, 

having a first position covering the lens of the camera and a second position 
exposing the lens, the mobile communication terminal preferably further 
comprising an actuator which actuates the lens cover from the first position to 
the second position and back. 



r00151 The mobile communication terminal may comprise a handle 

having a first position associated with the first position of the lens cover, the 
handle having a second position associated with the second position of the lens 
cover and the first position of the infrared filter, and the handle having a third 
position associated with the second position of said infrared filter 

r00161 The present invention further is a method for capturing infrared 

images with a mobile communication terminal equipped with a digital camera 
and an infrared port. This method of capturing infrared images comprises the 
steps of, 

- providing a mobile communication terminal comprising a digital camera and 
an infrared port, and 

- illuminating objects to be captured with the infrared light emitted by the 
infrared port. 

[00171 Preferably, the method further comprises the step of arranging 

the digital camera and the source of infra red light substantially in the same 
direction on the mobile communication terminal. 

r00181 The method may further comprise the step of providing an 

infrared filter for use when capturing images with visible light, and comprising 
the step of removing the infrared filter from the light path into the camera when 
capturing infrared images. 

r00191 When the camera comprises an auto focus system, the method 

may further comprise the step of adjusting the settings of the auto focus system 
to the characteristics of infrared light when capturing infrared images. 
[0020] When the mobile communication terminal comprises a display, 



the method may further comprise the step of displaying images captured by the 
digital camera on the display. 

r00211 The method may further comprise the step of capturing the 

images at short intervals thus, allowing the mobile communication terminal to 
be used as a night vision device. 

[0022] Further objects, features, advantages and properties of the 

invention will become apparent from the detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0023] In the following detailed portion of the present description, the 

invention will be explained in more detail with reference to the exemplary 
embodiments shown in the drawings, in which 

[0024] Fig. 1 shows in a perspective view the front of an embodiment of a 
communication terminal according to the invention, 

[0025] Fig. 2 shows in a perspective view the rear of an embodiment of a 
communication terminal according to the invention with the lens exposed, 
[0026] Fig. 2a shows in a perspective view the rear of an embodiment of a 
communication terminal according to the invention with the lens covered, and 
[00271 Figs. 3 a-3c shows an embodiment of a mechanism for contro ll ing 
providing different t he-positions of a cover for the camera module and fef 
control li ng th e pos i t i on of different positions of an infrared filter. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[002g] With reference to Figs. 1 and 2 X a mobile communication 

terminal according to the invention in the form of a hand portable phone 1 , 
preferably a c e l l ular! cellular mobile phone, provided with a camera is 
described. The phone 1 is provided with a front cover 2 having a window frame 
3 encircling the protection window of the display assembly. The phone 
comprises a user interface having an on/off button 4, a speaker 5 (only the 
openings are shown), a keypad 7, an LCD display 6 and a microphone (not 
shown). The LCD display may be a high resolution TFT matrix display for 
displaying high-resolution color pictures. The phone J-1_further comprises a 
battery pack 11. The keypad comprises a first group of alphanumeric keys 8, 
two multi-function keys 9 (so-called soft keys), two call handling keys 12, and a 
scroll key 19. The functionality of the keys and the user interface is well known 
and not explained in detail here. 

[0029] The mobile phone is provided with an infrared port 60 which 

comprises a cover and is transparent to infrared light . The infrared port is as 
such conventional and therefore not all features described here are shown in 
the drawings. Th e i nfrar e d port compr i s e s a cov e r 60 that is transpar e nt to 
infrar e d l ight. A n infrared transceiver is arranged under the cover 60. 
Commercially available infrared transceivers may be used in this application. 
The infrared transceiver comprises a source of infrared light in the form of an 
infrared LED (not shown). 
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r00301 The LED emits a beam of infrared light through the cover 60 in a 

direction that is substantially perpendicular to the rear surface 33 of the mobile 
phone. The infrared port provides for a wireless connection between the phone 
J-1_and its accessories, such as a personal computer, a printer, or another 
phone to transmit data, audio, control and logical signals between them. The 
general term "infrared light" as used here includes light with a wavelength of 
770 to 1000 pm. Infrared transceivers as used for infrared ports on mobile 
phones operate typically with a wavelength of 850-900 pm. 

r00311 The camera in the mobile phone is a conventional digital camera 

and therefore not all the features of the camera are shown. The camera uses 
one or more Charge Coupled Devices (CCDs) (not shown) for capturing 
images. The camera is further provided with a lens 36 and an auto focus 
system (not shown). A lens cover 42 protects the lens 36 and the camera from 
dust, direct sunlight and mechanical contact when the camera is turned off. The 
lens cover 42 is a slide cover that makes a sliding movement between a 
camera non-operating position, in which it covers at least the lens 36 and a 
camera operating position at which the lens is exposed. The camera is 
arranged at the rear of the mobile phone in the battery pack-44. The camera 
direction is therefore substantially perpendicular the-to the rear surface 33 of 
the mobile phone 1 . The camera has thus an angle of view directed away from 
the rear surface 33 of the mobile phone 1 . 

r00321 Standard CCD devices are sensitive to both visual light and near 

infrared light. Conventional digital cameras for capturing images with visual 
light are therefore provided with an infrared filter for preventing influences of 
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infrared light on the captured image. The mobile phone 4-IJs also provided with 
an infrared filter 43. The infrared filter 43 can though be moved out of the path 
of the light into the camera for capturing infrared images. 

[0033] The lens 36 is preferably a fixed focal length lens with a movable 

lens group to allow auto focus, however, lens 36 could be any plurality of lens 
providing for adjustment to focus on different parts of the image received, as 
will be understood to those skilled in the art. The characteristics of visible light 
and near infrared light with respect to focusing are slightly different. Therefore, 
the auto focus system has two settings; a first setting for capturing images with 
visual light and a second setting for infrared light. 

[0034] A standard software for processing, storing and recalling 

pictures captured with visual light and captured with infrared light is installed on 
the phone 1 . This software may as such be conventional and commercially 
available. The software is also able to control the refresh rate of the images 
shown on the display and the refresh rate of the captured images. 

[0035] A mechanism for moving the lens cover 42 and filter 43 is 

described with reference to Figs. 3a to 3c. The mechanism comprises a 
whee 40, a lens cover 42 and filter 43 and a connection between the wheel 40 
and the lens cover 42. The connection consists of a first link 46 and a second 
link 44 being connected in a joint 48. The first link 46 is attached to the lens 
cover 42 via a pivot point 45. The first link 47 is connected to the wheel 40 by a 
pivot point 47. The mechanism can move the lens cover 42 from a first, closed 
position to a second position and vice versa. An infrared filter 43 is connected 
to the lens cover 42 and moves integrally with the lens cover 42. In the second 
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position of the lens cover 42, the infrared filter 43 is in the path of the light 
falling into the camera (Fig 3b). There could of course be only one link or more 
than two links in the connection between the cover 42 and the wheel 40. The 
described mechanism has been simplified in that it does not include bearing, 
guiding elements, etc. to just show the essential parts of the mechanism. The 
wheel may be driven by an electrical actuator such as an electric motor or an 
electromagnetic actuator (not shown) or by a mechanical actuator such as a 
handle 49. As the wheel 40 is rotated, the link mechanism 45,46, will translate 
the rotating motion 51 of the wheel 40 into a linear motion 5352 of the lens 
cover 42 and the infrared filter 43. In Fig. 3a, the lens cover is in its first position 
where it covers and protects the camera lens 36 (not shown in Fig. 3a). The 
infrared filter 43 is in a parked position where it has no direct function. To move 
the lens cover 42 from its closed position, to its second position, and the 
infrared filter 43 from its parked position to its first position, the position in which 
the infrared filter 43 is in the light path into the camera, the wheel 40 is rotated 
in a clockwise direction 51 to move the pivot point 47 substantially above the 
center of the wheel as shown in Fig. 3b. When the lens cover 42 is moved to its 
second position, the open position, and the infrared filter 43 is moved to its first 
position, the camera lens 36 is exposed to the visible light, and the camera can 
be used to capture images with visible light. To move the lens cover back to its 
first position, the wheel 40 is rotated in an anticlockwise 53 (not shown) . 




not in the light path into the camera, the wheel 40 is rotated further in a 
clockwise direction 51 to move the pivot point 47 to be located to the right from 




[0036] 



-To move the infrared filter 43 to its second position, where it is 
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the center of rotation as shown in Fig. 3c. The lens cover 42 is now in its third 
position, which is also an open position, and the infrared filter is in its second 
position, in which it is not in the light path into the camera. The lens is now also 
exposed to infrared light, and can be used to capture images with infrared light. 
In this position of the infrared filter, the infrared LED of the infrared port can be 
activated. The angle of view of the camera and the light beam emitted by the 
infrared LED are aimed in substantially the same direction. There is thus a 
substantial overlap of the angle of view and the infrared light beam so that 
objects in the angle of view of the camera are illuminated by the infrared light 
beam. 

r00371 The infrared light beam overlaps preferably more than 60% of 

the angle of view and even more preferable more than 80% of the angle of view 
is overlapped by the infrared light beam. Thus, when the camera is aimed at an 
object to be photographed, the light emitted by the infrared LED is also directed 
to the object to be photographed which is illuminated with infrared light to 
enhance light intensity at which infrared images are captured. 

[0038] In another embodiment (not shown) the infrared port may also 

be arranged movable with respect to the mobile phone-M. Thus, the direction of 
the light beam emitted by the infrared LED can be directed towards an object to 
be illuminated. 

[0039] The camera may be provided with further filters (not shown) 

such as ultraviolet filters, optical low and high pass filters of various 
wavelengths of visible light as known to those skilled in the art. Those skilled in 
the art will realize other filter may be used. The image sensor may comprise 
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any of the known configurations for solid-state image sensors, such as frame 
transfer, interline transfer CCDs, or diode arrays 

r00401 The captured images are shown on the display 6. In one mode 

of the mobile phone M_stored images are displayed, whereas the images 
refreshed at a regular refresh rate are displayed in a second mode of the 
camera. When capturing infrared images in the second mode A the mobile 
phone J-1_may be used as a night vision device. 

r00411 Although one single actuating mechanism for controlling the lens 

cover and the infrared filter has been shown, it is possible to use a first 
mechanism for the lens cover and another mechanism for the infrared filter. 
The shown mechanism is mechanical. Other actuating mechanisms for 
controlling the position of the lens cover are of course also within the scope of 
the invention. Such mechanisms can be electro-mechanical, or electronic or 
other actuating devices generally used in camera technology. The camera has 
been shown as arranged in tbe-a_battery pack 44 of the mobile phone, but it is 
understood that the camera could be arranged in other places in the mobile 
phone. The same applies to the location of the infrared port, as long as the 
view angle of the camera and the light beam of the infrared port can have a 
substantial overlap. 
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ABSTRACT 



MOBILE TERMINAL WITH DIGITAL CAMERA 
AND METHOD OF CAPTURING VISIBILE AND INFRARED IMAGES 

The invention relates to a mobile communication terminal provided with a digital 
camera and an infrared port. The digital camera and the infrared port are arranged 
such that the infrared light emitted by the infrared port can be used to capture 
images with infrared light. 



